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Abstract: This study aims at finding out whether an alternate assessment 
strategy in Sustainable Developments module to improve the student’s 
employability skills and qualities. The exploratory studies, quantitative and 
qualitative questions acted as a data gathering instruments. The findings 
showed a need to change the current assessment strategy for Sustainable 
Developments module, proposed a new assessment approach and evaluated it. 
The research infers the studied institution should encourage academic staff to 
get familiar with the effective learning strategies, students learning styles and 
how to assess an assessment plan with graduate attributes model. A suggested 
direction for further research is to create an assessment model based on the 
students learning styles, assessment strategies and the workload information. 

Keywords: Graduate Attributes, Problem-Based Learning, Assessment 
Strategy, Employability Skills, Assessment Evaluation. 

INTRODUCTION 

In 2009, following the suggestions from the Quality Assurance Agency 
(QAA), Edinburgh Napier University (ENU) developed a graduate attributes 
model to inculcate professionalism among the students and to fulfil the needs 
of the employers (Edinburgh Napier University, 2009). The four essential 
dimensions of the ENU graduates are, 1) Application of & contribution to the 
knowledge, 2) Learning for life, 3) World of work prepared, 4) Citizenship. 
Considering the Validity, Reliability, Practicality, Cost-effectiveness, Fairness 
and Usefulness (V.R.P.C.F.U.) criteria (Brown and Knight, 1994), the current 
assessment scheme in the module Sustainable Developments (BSV 10104), 
does not test generic skills that students have developed over the course of their 
studies. Therefore, providing various assessments might improve the graduate 
attributes through building their confidence and increase employability. This 
study will thus, evaluate the Sustainable Development module taught in the 
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4 th year at ENU. It is a compulsory module for students studying on various 
built environment courses. The module is testing conceptual and disciplinary 
knowledge through a written, three-hour and essay-type examination. Although 
this method of assessment has advantages when dealing with large cohorts and 
managing tutor’s workloads, it does not teach effectively the application of 
knowledge which an alternate or another form of assessment might provide. 
Additionally, solely this method of assessment may create tension with the 
validity and fairness of the assessment potentially creating inequality within 
the whole student cohort which is against Edinburgh Napier University 
strategic aims. 

The study seeks to find out the possibility of using an alternative 
assessment strategy within the BSV10104 module, to improve the student’s 
learning experience, employability skills and attributes. The study objectives 
are 1) to appraise the reasons influencing assessment strategies. 2) to identify 
assessment strategies available for improved learning in a large cohort, 3) to 
evaluate current assessment practice and develop new methods of assessment 
within the BSV10104 module, 4) identify the area of development, 5) 
assess how the new proposed evaluation strategy could improve graduate 
employability skills and attributes. 


Evaluation of 
Assessment 
Method to 
Incorporate 
Graduate Attributes 
in Building 
Surveying Module 


RESEARCH DESIGN 


A review of relevant literature will help in evaluating methods of assessment 
available and their implementation in a large cohort. It will assist in identifying 
possible changes needed in the Learning, Teaching and Assessment (LTA) 
strategy of the module under study. An evaluation of the BSV10104 module 
will comprise of critiquing the current LTA approach, and the student’s feedback 
received through the survey questionnaires. The assessment of the “V.R.P.C.F.U.” 
criteria of the assessment scheme and the analysis of each activity’s cognitive 
level will help in the evaluation. Questionnaires will appraise the degree to the 
students’ satisfaction and students’ attributes developed by the module. These 
will contribute to identifying needed improvements to the module. Finally, 
the Higher Education Academy (HEA) (2011) “Assessment Audit Tool”, 
“Employability Audit Tool” and Edinburgh Napier University’s “Module 
Evaluation Checklist” will help in self-evaluation of the current BSV10104 
assessment strategy. Bloom’s cognitive levels, students’ employability skills and 
attributes, as well as the assessment for learning and V.R.P.C.F.U. Criteria will 
help in evaluating the proposed new assessment scheme. The same audit tools 
and evaluation checklist mentioned above will assist in the self-evaluation of the 
new draft assessment strategy. The exploratory and descriptive analysis will help 
in identifying the trends in this research. 
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LITERATURE REVIEW 

Crossling & Webb (2002) outlined the increase in diversity of the Higher 
Education student population over recent years such as (1) race/ethnicity 
(2) disability, (3) gender, (4) age (traditional or returning students), (5) 
socioeconomic status, (6) residential status (campus residents), (7) sexual 
orientation, (8) religion/belief, (9) national citizenship (domestic or 
international students), (10) learning styles, (11) mode of attendance Part Time/ 
Full Time, (12) educational background and experiences, (13) personality 
profile (Edinburgh Napier University, 2012a; Benzies, 2011; Cuseo, 1992). 
It is important to consider the above aspects when planning the curriculum 
to ensure no different levels of knowledge and skills occur between distinct 
groups of students and to meet the diverse needs of all students. (Cuseo, 1992). 

Previous research (Biggs and Tang, 2007) outline the intrinsic li nk 
between students’ learning approaches with students’ achievement of learning 
outcomes. Teaching and Assessment Methods significantly affect students’ 
approaches to learning. Although students are likely to have a varied approach 
to learning integrating ideas of both surface and strategic or deep & strategic 
approaches, teaching and assessment methods need to adapt to students need 
and divcrsity(Rodriguez and Francisco Cano, 2007). Biggs and Tang(2007) 
studies have outlined that constructively aligned courses encourage students 
to adopt a deep learning approach and increase students’ level of cognitive 
learning. 

Assessing a large student cohort with a diverse mix of students with 
different needs significantly increase marking and feedback workloads for 
staff and is challenging to keep consistency and reliability in marks. University 
of Reading (2013) studies suggests different assessment strategies in finding 
efficient ways to assess students and provide them with effective feedback 
supporting their learning such as 1) Clarification of criteria strategy, 2) Do it 
in class, 3) Self and Peer Assessment, 4) Group assessment, 5) Mechanise the 
assessment, 6) Interactive online discussions, 7) Strategic reduction. 

Kolb (1984) considers learning as a cyclical process progressing from 
the actual learning experience through case-studies, to the reflection through 
lectures and tests, to the conceptualisation and active experimentation through 
reading, projects, and discussions. Additionally, previous research suggests 
that assessment is the centre of the student learning experience and the 
assessment’s demand, and quality control the students’ engagement in learning 
(Brown and Knight, 1994). Efficient use of the assessment can also promote 
learning, engagement and higher cognitive competencies through students 
gaining an insight into their progress and skills (Harrison and Black, 2004). 
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Struyven, Dochy and Janssens (2005) outline five most important aspects 
of assessment in improving the student experience. It should be 1) related 
to authentic tasks, 2) be reasonable in demand, 3) support the application of 
knowledge within real contexts, 4) encourage competence development, and 
5) demonstrate long-term benefits. 

Various authors outline practices to align higher education with long learning 
through sustainable, learning orientated assessment (formative or summative) 
providing students with the ability to meet their future learning needs (Boud, 
2000). They highlight the need for students to become assessors within the 
context of participation in practice, thus reproducing learning faced in life and 
work. This approach is in alignment with the Edinburgh Napier University LTA 
strategy aimed at developing self-confidence, ability and attributes of students 
to make them highly employable (ENU, 2011a). Edinburgh Napier University’s 
employability skills and attributes as shown in Figure 1 below. 
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Key skills 
time management 
study skills 

communication: written and oral 
application of numbers 
information/communication 
technology 
working with others 
problem-solving 


Traditional intellectual skills 
critical evaluation of evidence 
argue logically 
apply theory to practice 
model problems qualitatively 
quantatively 

challenge taken-for-granted 
assumptions 


Personal qualitites 
self-motivation 
self-reliance 
adaptability/flexibility 
personal values 
nous/commonsense 
creativity 



Understanding of how 
organisations work 
knowledge of 
working practices 
professional behaviour 
recognition of 
organisational structure 


Reflective skills 
learning to learn 

identification of own strengths and development needs 
continuously improving one's own performance 

Figure 1: Student employability skills and attributes 
(Source: Edinburgh Napier University, 2011a) 
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Selecting a suitable assessment strategy to support the learning outcomes (LOs) 
(see Appendix I) of the curriculum is essential to improve the students’ experience 
while also developing general skills and abilities within disciplinary contexts 
(Crooks, 1988). There are different types of assessment coexisting within Higher 
Education from summative to formative assessment. Providing productive and 
efficient feedback on specific assessments is essential to improve the student 
learning, development, and teaching experience. Keppell and Carless (2006) 
outline how student learning is likely to improve by using various assessment tasks 
within a module, thus supporting different ways of learning. The combination 
of series of evaluations works and by viewing it as an integral unit of teaching 
and learning can help in the development of an effective assessment practice. 
However, previous research also outlines that if a student can manage an individual 
assessment on its own, the set of tasks as a whole can be too demanding for them, 
and they may become very selective in the tasks they focus on (Lindberg-Sand 
and Olsson, 2008). Indeed, Struyven, Dochy and Janssens (2005) suggest that 
although students feel alternative assessments as better methods to achieve deep 
learning, heavy workloads would hinder real studying and thus deep learning 
(Chambers, 1992). The evaluation scheme must, therefore, consider the five key 
criteria of Validity, Reliability, Practicality, Cost-effectiveness, Fairness and 
Usefulness to ensure it is suitable and aligned with module contents and teaching 
methods (Brown and Knight, 1994; Freeman and Fewis, 1998). Additionally, 
previous modules evaluation showed that Biggs’ model of constructive alignment 
is essential to allow the learner to improve and achieve independence. Meaningful 
development of the learning activities and assessments need in alignment to 
FOs to ensure a good experience (Biggs, 1999). FTA strategy is the means of 
delivering the module aims through linking learning, teaching, and assessment. 
The alignment between learning activities, teaching and assessment procedures 
needs a continuous evaluation from student’s feedback and interaction between 
involved parties, needs to be addressed in this study (Teixeira-Dias et al., 2005). 

Assessment for Fearning (AfL) also referred as “alternative assessment”. 
It is an evaluation environment that “is rich informal feedback (tutor & 
self-assessment systems), is rich in informal feedback (dialogue & peer- 
interaction), provide opportunities to try out and practice knowledge, skills 
and understanding, has assessment tasks which are authentic or relevant. It 
helps students to develop independence and autonomy and has an appropriate 
balance between formative and summative assessment” (McDowell et ah, 
2011, p.750). 

Problem-Based Fearning (PBF) is a “learning environment where 
the problem drives the learning” (Klegeris and Hurren, 2011). Pedrosa 
de Jesus and Coelho Moreira (2009) outlined the deep engagement of 
students within formative and summative problem-based cases, supporting 
the use of these alternative assessment tools for lifelong learning skills 
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development. This learning technique has also shown to increase student’s Evaluation of 
experience with a high student satisfaction and to promote employability Assessment 
skills and attributes (Kelgeris and Hurren, 2011). Wood (2003) describes Method to 
PBL in seven steps such as 1) situation and terminology clarification, Incorporate 
2) problem identification, 3) suggestions of possible causes/hypothesis, Graduate Attributes 
4) the connection of problems and causes, 5) a decision on information in Building 
collection needed 6) obtain information, 7) apply information. While Surveying Module 

PBL’s extensive use in small group settings and showed significant benefits - 

such as improving problem-solving skills, retention of information, 
increasing students motivation and participation. PBL has application in a 
large student cohort by combining a PBL tutor less groups approach with 
standard lectures (Klegeris and Hurren, 2011). 

Evaluation of the current module LTA Strategy 

Using the BSV10104 Module Descriptor, a general assessment of the LTA 
strategy helped in identifying the constructive alignment of the learning 
outcomes (LOs) and evaluation method. 


Table 1: Relationship between LOs, Bloom’s cognitive domain and SMART 

system 


LOs 

SMART 

BLOOM 


S* 

M* 

A* 

R* 

j* 

Cognitive 

LOl: interpret and analyse environ- 

Y 

Y 

Y 

✓ 

Y 

Y 

mental policy at global and local levels 






C , An** 

L02: explain and evaluate the prin- 

Y 

Y 

Y 

Y 

Y 

Y 

ciples of environmental issues in the 
development life cycle 






C, E** 

L03: evaluate, propose and justify the 

X 

Y 

Y 

Y 

Y 

Y 

choices available for components in the 






An, S, 

development of buildings 






E** 

L04: assess the legislative factors 

X 

Y 

Y 

Y 

Y 

Y 

affecting environmental planning and 
sustainable development 






E** 

L05: assess environmental impact of 

X 

Y 

Y 

Y 

Y 

Y 

developments on the environment 






E** 

L06: evaluate developments in local 

X 

Y 

Y 

Y 

Y 

Y 

energy and environmental planning 






E** 


*S.M.A.R.T.: Specific, Measurable, Achievable, Relevant and Time-restricted 

**K.C.Ap.An.S.E.: Knowledge, Comprehension, Application, Analysis, Synthesis, 
Evaluation. 


123 



















Chowdhry, S. 
Gamier, C. 


Table 2: Current LTA strategy against Bloom’s cognitive domain 



Bloom’s cognitive domain 

Assessment Scheme 

K* 

C * 

Ap * 

An * 

S* 

E* 

Exam 

A 

A 

- 

A 

A 

A 

Non-assessed activities 


Research Activities 

A 

A 

- 

- 

- 

- 

Reflection Activities 

- 

- 

A 

A 

A 

A 

Discussions 





A 

A 


*K.C.Ap.An.S.E.: Knowledge, Comprehension, Application, Analysis, Synthesis, 
Evaluation. 

Table 3: Current LTA strategy against employability skills and attributes 



Employability skills and attributes 

Assessment Scheme 

p* 

Co* 

Cr* 

I* 

D* 

J* 

M* 

N* 

Exam 

A 

- 

A 

A 

- 

- 

A 

A 

Non-assessed activities 


Research Activities 

- 

- 

- 

A 

- 

- 

A 

A 

Reflection Activities 

A 

- 

A 

A 

A 

- 

A 

A 

Discussions 

- 

A 

A 

- 

- 

A 

A 

A 


* P, Co, Cr, I, D, T, M, N: Problem formulation and solving, communication and 
cooperation, critical and creative thinking, independent learner, decision-making, 
teamwork and group leadership, management of time and resources; and numeracy 
and intellectual skills. 


Table 4: Current LTA strategy against assessment for learning (Afl) 
environment criteria 



Afl Environment Criteria 

Assessment Scheme 

FF* 

IF* 

p* 

R* 

Di* 

B* 

Exam 

- 

A 

- 

A 

- 

- 

Non-assessed activities 


Research Activities 

- 

A 

- 

- 

- 

- 
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Afl Environment Criteria 

Reflection Activities 

- 

Y 

y 

Y 

Y 

- 

Discussions 

- 

Y 

Y 

Y 

Y 

- 


* FF, IF, P, R, Di, B: Formal feedback, Informal feedback, Practice knowledge / skills 
/ understanding, Relevant tasks, Develop independence, Balanced formative and sum- 
mative assessment. 
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Table 5: Current assessment scheme against assessment criteria 



Assessment criteria 

Assessment Scheme 

R* 

QL* 

F* 

Exam 

Y 

- 

- 

Non-assessed activities 


Research Activities 

Y 

- 

- 

Reflection Activities 

- 

Y 

- 

Discussions 

Y 

Y 

- 


* R, QL, F: Reasonable in demand, Quality and Level of student effort, Feedback 


The current LTA policy evaluation results show the different learning styles 
and competencies are not adjusted suitably. It did not embrace the University’s 
LTA Strategy and some of ENU’s principles such as 1) forming active learner, 
2) emphasising collaborative learning, 3) personalising learning tasks, 4) 
using technology to enhance LTA of student learning, 5) proposing frequent 
formative assessment, 6) developing student autonomy (Edinburgh Napier 
University, 2010 & 2013). 

The evaluation above outlines the need to develop a well-structured and 
progressive timetable li nk ed to LOs and to carry out an improved assessment 
scheme. It suggests the use of formative assessment and formal feedback 
provision with a need to use various assessment methods to test and increase 
students’ employability skills. The evaluation scheme should also be an integral 
part of the learning process and promote learning as well as the application 
of knowledge while also providing formative feedback to the students about 
their overall performance (Juwah et al., 2004).The new version of the current 
LTA strategy should, therefore, ensure clarity, transparency and constructive 
alignment while considering critical feasibility criteria such as the V.R.P.C.F.U. 
factors. Additionally, some form of formative feedback on the module from 
students will be useful to reflect further on the module’s overall effectiveness. 
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Students’ appraisal of current LTA Strategy 

Data Collection 

Three semi-structured questionnaires (see Appendix I), were used to 
collect data at the beginning, middle and the end of trimester one. These 
questionnaires helped to evaluate the students’ expectations by taking 
the module, to assess cognitive level achieved and attributes developed 
by current activities and assessment methods while also addressing any 
confusion and changes needed to improve students’ experience and qualities. 
The combination of the questionnaires results helped in comparing with the 
time of answers. 

Data Analysis 

Surveys 1 and 2 had a 60% and 56% response rate respectively while the 
end-of-class questionnaire achieved a 48% response rate. This high response 
rate should allow the tutor to draw meaningful conclusions from the ques¬ 
tionnaires outputs. 



Figure 2: Initial student cohort understanding of what “Sustainable develop¬ 
ment” means 

Figure 2 shows that students outlined all the concepts involved in sustainable 
development with an emphasis on buildings. 
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■ Material use/selection (low impact) 

■ Energy efficient buildings / design 

■ Economically efficient building / design 
(life) 

■ Building environmental impact 
(footprint) 

■ Sustainable energy generation 

■ Preserve greenfield 

■ Waste generation & management 

■ Social fairness 

Energy resources use & management 


Evaluation of 
Assessment 
Method to 
Incorporate 
Graduate Attributes 
in Building 
Surveying Module 


Figure 3: Student’s programme share of what “Sustainable development” means 

Figure 3 further supports it, by showing the widespread across the student 
groups of different disciplines and their understanding of what sustainable 
development involves. 


70% 



Stage 1: Beginning Stage2: Middle Stage3:End 


■ 1: Very little 

■ 2: Little 

■ 3: Avergae 

■ 4: Good 

■ 5: Very Good 


Figure 4: Percentage rate of students’ understanding of Sustainable Development 

Figure 4 below outlines that the students feel their knowledge of the topic 
has progressed significantly. At the beginning of the course, only 10% 
of students felt they had either a good or very good understanding of 
sustainable development, and it increased to 91% at the end of the module 
with a clear evolution as the module progressed (based on stage 2 results). 
Figure 5 and 6 below shows the students’ aspirations are established 
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in the first questionnaire. All programs emphasised the integration of 
sustainability within their respective professions and passing the module 
as other desires. 


■ Increase knowledge in 
Sustainable Development 

■ Pass / Achieve high grades 
in the module 

■ Future employment / 
Profession 

■ Be ableto put in into 
practice what is learned 


Figure 5: Students’ initial rating of aspirations from undertaking 

BSV10104 



Figure 6: Students’ initial aspirations rate by programme from undertaking 

BSV10104 

Figure 5 and 6 below shows students’ aims. All programs highlighted the 
integration of sustainability within their respective professions and passing the 
module as other wants. 



128 
































70% 

60% 

50% 

40% 

30% 

20 % 

10 % 

0 % 



Stage 2: Middle 



■ 1: Very Bad 

■ 2: Bad 
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Figure 7: Students’ rate on whether aspirations were achieved 


Figure 7 suggests that students believe the course had achieved their ideals 
either well or very well at both the middle (81%) and end of trimester (84%) 
surveys. 


5: Very Well 
4: Well 
3: Average 
2: Bad 
1: Very Bad 


Building Surveying 



Architecture Technology 
5: Very Well 



5: Very Well 
4: Well 
3: Average 
2: Bad 
1: Very Bad 


Quantity Surveying 



Construction and Project Management 



Figure 8: Evolution on whether aspirations were achieved by student cohorts 

Figure 8 below however outlines a slight decline (from “Very Well” to “Well”) 
in meeting student’s ideals as the module progressed, mainly credited to 
Building Surveyors (BS) and Construction and Project Managers (CPM). 
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25% 


20 % 

15% 

10 % 

5% 


0 % 



More time 

Essential for Anxious about 

Further 

Very inspiring 

No CW to 

available for 

future career the exam 

interest 

& relevant to 

provide a 

this module 


generated in 

many different 

deeper 

would be 


the domain 

part of the 

undertsanding 

better to 
achieve 
aspirations 


area 

course thus 
helpful 

and cover topic 
of interest (e.g. 
Building 
Systems and 
Materials) 


■ 1: Very Bad 

■ 2: Bad 

■ 3: Average 

■ 4: Well 

■ 5: Very Well 


Figure 9: Students’ comments their rating on whether aspirations were 

achieved 


Figure 9 shows that students highlighted areas of good practices and positives 
outcomes while also outlining the need to apply further their knowledge and 
spend more time on the module. 

7 0% 

60% 

so% 

40% 

30% 

20 % 

10 % 

0 % 

Stage 2: Stage 3: End Stage 2: Stage 3; End Stage 2: Stage 3: End 
Middle Middle Middle 

Contents Challenges Time 

Figure 10: Students’ opinion on teaching contents, materials and activities 

Figure 10 suggests, the students rated the current course contents as being 
either good or very good in both the middle (85%) and end (93%) of trimester 
surveys. 
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Figure 11: Students’ comments on course contents 


Comments from students shown in Figure 11 outlined good practices within 
the modules while also suggesting the quantity of information provided in 
classes can be overwhelming. 



Very relevant & 
Interesting: Make you 
question & think of the 
reasoning behind a lot of 
aspects 


A lot of work required 
with a lot information/ 
resource to look at 


Unsure what level is 
expected with no example 
of good answers provided 


Good preparation for 
exam 


Figure 12: Students’ comments on course challenges 


Figure 12 shows how 49% of students felt the activities allowed them to 
develop reasoning and high cognitive skills and to prepare them for the 
exam. However, 28% of students felt it wanted a significant input from 
students while 23% felt the lack of support and expectations were not 
transparent. 
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25% 



Very relevant & A lot of work required Unsure what level is Good preparation for 
Interesting: Make you with a lot information/ expected with no exam 

question & think of the resource to look at example of good 

reasoning behind a lot answers provided 

of aspects 


■ Very Good 

■ Good 

■ Average 

■ Bad 

■ Very Bad 


Figure 13: Students’ comments on course challenges with rating 

Figure 13 shows the issues outlined by students about high work¬ 
load and lack of transparency/formal feedback apply to the whole 
cohort. 

35% 

30% 

25% 

20% 

15% 

10 % 

5% 

0% 

Very time consuming Time restriction due Careful time Lotsof time available 
to fulfil activities to toclashesand managementand (Erasmus) 

good standard expectations from scheduling required to 

other modules undertake each 

(Project Evaluation & appropriately (short 
Dissertation) time scale - weekly 

Figure 14: Students’ comments on time available to undertake course 

activities 

Figure 14 below shows that 23% of students felt the need to improve 
time-management skills to take all discussions in a timely and efficient 
manner. While another 66% could not undertake activities to the right 
standards due to the number of activities provided, time limits and 
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expectations from other modules such as the Project evaluation and 
Dissertation modules. 



Very time consuming Time restriction due Careful time Lots of time available 
to fulfil activities to toclashesand managementand (Erasmus) 

good standard expectations from scheduling required 
other modules to undertake each 

(Project Evaluation & appropriately (short 
Dissertation) time scale - weekly 

activities good) 


■ Very Good 

■ Good 

■ Average 

■ Bad 

■ Very Bad 
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Figure 15: Students’ comments on time available to undertake course activi¬ 
ties with rating 

Figure 15, displays the current activities may not be reasonable in demand 
about quantity and distribution towards the issue of time availability and 
clashes with other programs. 



■ Materials (Energy efficient / Eco-friendly) 

■ Concept Design / Building Design (Layout, Ventilation...) 

■ Project Evaluation 

■ Final Design Project / Dissertation 

■ Construction methods (Efficient/Minimising waste) 

■ Energy generation systems 

■ Changes In regulations 

■ Lard use 

Carbon Footprinting 
Sustainable afforoable solutions 


Figure 16: Overall student cohort rate of module relevance to programmes 

of study 
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Figure 16 outlines the overall student cohort opinion most of which directly 
link it, again, to buildings. Flowever, linkage to other modules undertaken 
by students (e.g. Dissertation, Final Design Project and Project Evaluation) 
suggests, there is a real cohesion in their program of study with modules 
telling/feeding to each other. Students’ linkage is in appropriate alignment 
with the topics covered in the module, thus providing confidence, the 
module should fulfil their ambition and integrate well with their individual 
programs. 
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Building Architecture Quantity Contruction and Exchange Built 
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■ Materials (Energy efficicent / Eco-friendly) 


■ Concept Design / Building Design (Layout, 
Ventilation...) 

■ Project Evaluation 

■ Final Design Project/ Dissertation 

■ Construction methods (Efficient/Minimising 
waste) 

■ Energy generation systems 


■ Changes in regulations 

■ Land use 

: i Carbon Footprinting 

■ Sustainable affordable solutions 


Figure 17: Student’s rate of module relevance by programme 

Figure 17 establishes the expected linkage of students from different 
programs. All mention “construction methods”, thus emphasising 
“buildings” as an area of focus. Interestingly, each programme liaison 
to SD is with their speciality with BS relating more to “Materials”; 
Architecture Technologist (AT) to “Concept Design/ Building Design” and 
“Materials”; Quantity Surveyors (QS) to “Sustainable affordable solutions” 
thus including a cost factor. CPM to more “construction methods” mainly 
and Built Environment (BE) students to both “Building Design and 
“Construction methods”. CPM students were, however, the only ones to 
clearly see the benefit of studying. 

SD compared to their other modules, showing the “broad” vision expected 
from CPM graduates. 
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Figure 18: Percentage rate of Module relevance to programme of study 


Figure 18 suggests that all students rated the current module as being either 
very relevant or relevant. The majority of students rated the current module 
as being very relevant to both the middle (75%) and end (63%) of trimester 
surveys. Whereas, Building Surveyors and Architecture Technologists rated 
decrease in relevance. Areas of interest previously outlined to “materials” and 
“concept/building design” as well as ideals to apply the knowledge, may be the 
reason for their low rating of the relevance. 
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Figure 19: Students’ opinion rate on areas of study to make BSV10104 more 
relevant to specific course and the cohort as a whole 
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Figure 20: Students’ percentage rate in change of opinion in areas of interest / 

topic to cover in more depth 

Figure 19 and 20 clearly outline that the subject of sustainable construction 
and low carbon building designs remained an area of interest for students 
throughout the module while topics such as “low and zero carbon energy 
technologies” and “sustainable transport strategies” grew in popularity as the 
module progressed. These results indicate use of added assessment can further 
help in covering these possible areas. 

o% 

■ 1: Really Not 
Adequate 

■ 2: Not Adequate 

■ 3: Average 

■ 4: Adequate 

■ 5: Very Adequate 


Figure 21: Students’ opinion rate on adequacy of assessment method to test 

their abilities 

Figure 21 suggests that about 72% of students identified the current evaluation 
methodology to be acceptable to test their knowledge and skills while 23% 
classify it as average and 2% as inadequate. 
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Figure 22: Students’ comments on adequacy of assessment method in relation 

to their rating 

Figure 22 shows that 58% would prefer to have an another marked formative 
assessment. Another 8% believe that an alternative to exam should assess such 
big topics and vast study material. Therefore these results suggest that 66% 
of students would support the implementation of some alternative or another 
method of assessment. It also outlines the possible need to narrow down the 
scope of the module to make it more accurate and thus not overwhelm students 
with a lot of materials. 

■ S. Agree 

■ Agree 

■ Disagree 

■ S. Disagree 

■ Neither Agree / 

Disagree 

Figure 23: Students’ opinion on whether a Coursework could be integrated 

Figure 23 shows that only 41% suggested its integration to the Project 
Evaluation module. Unfortunately, such integration would not be feasible as 
the cohort includes Part-time and Erasmus students whose study structure does 
not contain project evaluation in the same year or at all. 
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Figure 24: Cognitive level of module activities and assessment scheme 


Figure 24 shows the fina l exam activity achieved all levels ofBloom’s cognitive domain 
including two of the highest levels as it assessed students’ individual knowledge as 
well as evaluation and synthesis skills in tackling theoretical application. Flowever, 
most of the students identified this method as chiefly evaluate the lowest order of 
thinking “knowledge”. Interestingly, research activities helped in awareness and 
understanding development, while reflection activities (and discussions) contributed 
to developing analysis than both the exam and research activities. 
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Figure 25: Module’s individual activities and level of cognition 
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Figure 25 shows that the final exam has a cognitive distribution of 23% 
knowledge, 14% understanding, 16% application, 14% analysis, 16% 
synthesis, and 16% evaluation. It outlines that 40% of the students identified 
exam to challenge them at the lower cognitive levels while 60% challenged 
the students at, the higher cognitive levels. Additionally, 24% of the reflection 
activities and 42% of the research activities challenged students at the lower 
cognitive levels while 78% and 58% of the thinking and research activities 
respectively challenged the students at the higher cognitive levels. It explains 
the research activities overall have a greater impact on students’ learning. 
Table 6 shows students evaluation of the portion of lower and higher cognitive 
level in each assessment exercise. 


Table 6: Students’ evaluation of available assessment methods and level of 

cognition 



Lower Cognitive 
Levels 

Higher Cognitive 
Levels 

Problem Based Learning report 

46% 

54% 

Individual Written report 

43% 

57% 

Group Written report 

36% 

64% 

Individual Presentations 

38% 

62% 

Group Presentations 

39% 

61% 

Poster Presentations 

36% 

64% 

Quizzes 

48% 

52% 

Midterm exams 

42% 

58% 

Final Exam 

42% 

58% 
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The resulting cognitive analysis describes that group written reports, poster 
presentations and individual and group presentations hold more merits among 
students as achieving higher cognitive levels while quizzes, PBL report have 
a greater proportion of lower cognitive levels. Individual written reports and 
mid and final exams were all set up to challenge students between 44 to 45% at 
the lower cognitive levels and 57 to 58% at the higher cognitive levels. 

Audit of BSV10104 current method of assessment 

Different audit tools and a checklist (see Appendix II) helped in a self-assess¬ 
ment of the current BSV10104 assessment scheme. 

The “Assessment Audit Tool” uses a numeric scoring system from 0 
(not considered) to 4 (optimally satisfied) and analyses audit points scoring 
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2 or less. By making a subjective judgment and scoring various aspects of 
assessment included in the audit tool helped to identify some of the main 
issues occurring within the BSV10104 assessment scheme such as 1) assessing 
students’ abilities, 2) while developing alternate assessment, need to consider 
plagiarism, students’ workload and marking overload, 3) unclear marking 
criteria, 4) exemplary answers not available, 5) students are not continuously 
assessed, 6) all students do not receive feedback. 

The “Employability Audit Tool” used the same scoring system as the 
“Assessment Audit Tool” above. Although mainly developed for a program 
level analysis, some sections did also apply to modules. The areas of 
improvements are, 1) academic staff should be informed about the employers 
and their procedure of judging the strengths and weakness of the student, 2) 
use of realistic simulations in teaching, 3) assessing students’ generic skills, 4) 
to give assessment choice to the students. 

The “Module Evaluation Checklist” helped in identifying improvements 
in teaching practice such as 1) consideration of students’ workloads, 2) 
periodically assessed self-tests or reflective tasks/activities should be used 
to ensure students’ engagement and development, 3) online communication 
and collaboration on the main tasks. 

All evaluation methods support the use of an alternative method of 
assessment to be developed to support different learning styles and interests, 
check student’s development, provide formal feedback and develop life¬ 
long learning skills. The proposed method should, however, consider the 
impact it has on students and staff workloads. Additionally, a clear hint 
of students’ strengths and weaknesses made out by graduate employers’ 
would be highly useful to tell module contents and evaluation methods. 

Proposed Assessment Strategy 

In the proposed assessment (see Appendix III), the reflection activities 
are adjusted to become interactive online discussion and their numbers 
reduced to consider the overall student’s workloads. The interactive online 
discussion is encouraged to strengthen interchange of ideas, develop their 
analysis and critical skills, and provide lifelong learning skills. A small 
credit (5%) could be granted to student’s participation in this activity to 
encourage students’ involvement. Removed research activities as they did 
not have a significant impact on students learning. The final traditional 
exam assessment method will be adapted to encompass another form of 
assessment. 

A problem-based learning real case scenario on “sustainable 
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construction/ low carbon building designs” is introduced to students in 
the first week of teaching. About four to five issues may be provided with 
the case scenario. These would be developed in alignment to LOs and to 
reflect the different interests identified within the large student cohorts (e.g. 
Current and added green value; Green designed features and potential; 
Costs assessment and sustainable impact; Building materials sustainability 
and footprint; Energy and sustainable technologies). Students need to 
join online one of the groups looking at one particular issue from the list 
provided by the tutor. A group will have 6 to 8 members. Students, then 
go through the PBL seven classical steps and present their findings as well 
as the methods they used to tackle their particular topic (thus outlining 
how they addressed the PBL steps). The group output may be either 
through group poster display or group presentations which could occur in 
week eight as this does not collide with any of the Project Evaluation or 
Dissertation Modules submissions and intermediate presentations weeks. This 
group work element would allow students to develop skills and to leam from the 
experience and knowledge of their peers. Detailed formal feedback on their work 
including contents, presentation, structure, methods, strengths and weaknesses 
and how they meet or not the marking scheme wants could then be provided 
immediately by a group to group peer-assessment and a panel of markers. This 
arrangement will overcome the issue of non-anonymous marking and ensure 
fairness of the assessment scheme. Time spent on feedback, have to be managed 
by using criterion focused feedback form. Additionally, including a form of team 
peer-assessment and self-assessment against a predefined evaluation criterion 
grid will overcome the impact of having poor performers penalising a group’s 
overall performance. As a result, a strategic decrease may be applied in the 
exam to balance the tutors’ workload. Instead of students having to answer four 
out of six questions, the exam may be structured in three questions. Question 
one will be compulsory and related to the group assignment projects. Specific 
questions on each listed topics will be provided. This first question is likely to 
cover LOs 3-5 (see Appendix I).Students will have the choice to answer two 
of the three remaining questions which may be developed with the interactive 
online discussions. 
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Proposed New Assessment Scheme Evaluation 

The new proposed assessment scheme evaluation using the “V.R.P.C.F.U.” 
criteria is shown in Table 7 below, Bloom’s cognitive domain (Table 8), 
graduates’ employability skills (Table 9)and assessment for learning criteria 
(Table 10 and 11). 


141 





Chowdhry, S. 
Gamier, C. 


Table 7: Proposed assessment scheme considered against the five key criteria 


Assessment Scheme 

Key Criteria 

y* 

R* 

P&C* 

F* 

U* 

Peer-assessment marking 

- 

P 

P 

P 

P 

Self-assessment marking 

- 

P 

P 

P 

P 

Group-assessment marking 

- 

P 

P 

P 

P 

Group/Poster Presentations 

p 

P 

- 

P 

P 

Interactive online discussions 

p 

- 

P 

P 

P 

Final exam 

p 

P 

P 

- 

- 


*V.R.P.C.F.U..: Validity, Reliability, Practicality and Cost effectiveness, Fairness 
and Usefulness 

Table 8: Proposed assessment scheme considered against Bloom’s cognitive domain 


Assessment Scheme 

Bloom’s cognitive domain 

K* 

c* 

Ap * 

An * 

s* 

E* 

Peer-assessment marking 

- 

- 

- 

- 


v' 

Self-assessment marking 

- 

- 

- 

- 

■/ 

v' 

Group-assessment marking 

- 

- 

- 

- 

■/ 

v' 

Group/Poster Presentations 





s 

y 

Interactive online discussions 

- 

- 

•/ 

•/ 

s 

y 

Final exam 


•/ 

- 

•/ 

s 



*K.C.Ap.An.S.E.: Knowledge, Comprehension, Application, Analysis, Synthesis, Evaluation. 
Table 9: Proposed assessment scheme considered against employability skills 


Assessment Scheme 

Employability skills and attributes 

p* 

Co* 

Cr* 

I* 

D* 


M* 

N* 

Peer-assessment marking 

- 



- 

/ 

- 

- 

- 

Self-assessment marking 

- 

- 


- 

/ 

- 

- 

- 

Group-assessment marking 

- 


/ 

- 

/ 

- 

- 

- 

Group/Poster Presentations 

/ 

/ 

/ 


/ 




Interactive online discussions 

/ 


/ 



- 



Final exam 

/ 

- 



- 

- 




* P, Co, Cr, I, D, T, M, N: Problem formulation and solving, communication and co¬ 
operation, critical and creative thinking, independent learner, decision-making, team¬ 
work and group leadership, management of time and resources; and numeracy and 
intellectual skills. 
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Table 10: Proposed assessment scheme considered against assessment for 
learning (Afl) environment criteria 


Assessment Scheme 

Afl environment criteria 

FF* 

IF* 

p* 

R* 

Di* 

B* 

Peer-assessment marking 

Y 

- 

Y 

- 

Y 

/ 

Self-assessment marking 

Y 

- 

y 

- 

Y 

Y 

Group-assessment marking 

y 

- 

Y 

- 

Y 

Y 

Group/Poster Presentations 

y 

- 

y 

Y 

Y 

Y 

Interactive online discussions 

- 

Y 

y 

Y 

Y 

Y 

Final exam 

- 

Y 

- 

Y 

- 

- 
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* FF, IF, P, R, Di, B: Formal feedback, Informal feedback, Practice knowledge / skills 
/ understanding, Relevant tasks, Develop independence, Balanced formative and 
summative assessment. 


Table 11: Proposed assessment scheme considered against assessment criteria 


Assessment Scheme 

Assessment criteria 

R* 

QL* 

F* 

Peer-assessment marking 

Y 

Y 

Y 

Self-assessment marking 

Y 

Y 

Y 

Group-assessment marking 

Y 

Y 

Y 

Group/Poster Presentations 

Y 

Y 

Y 

Interactive online discussions 

Y 

Y 

Y 

Final exam 

Y 

- 

- 


* R, QL, F: Reasonable in demand, Quality and Level of student effort, Feedback 


This new assessment scheme balances formative and summative assessments. 
The variety of assessment methods used considers different learning styles and 
accounts for diversity and the development of graduate attributes. The use of 
clear marking criteria, anonymous team peer-review, peer group review and 
panel marking, as well as the inclusion of a self-assessment and one project 
based exam question, strengthens the fairness of the assessment scheme. 

It increases the usefulness of the proposed assessment plan compared with 
the current one. Not only can it promote effective learning strategies through 
varied progressive tasks, but it can also provide timely formative feedback to 
students. It encourages students to share ideas, thi nk s critically, present rational 
arguments and challenges themselves. Hounsell (2003) suggests that students’ 
involvement in the generation of feedback is valuable to their overall experience 
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and encourage more self-reflection on their personal attainment. The scheme 
would thus provide lifelong learning and employability skills as well as promote 
a deeper approach to learning. Additionally, this assessment plan supports the 
application of knowledge within real contexts while also encourage competence 
development. Therefore, it strengthens the usefulness of this evaluation scheme. 

Although the time needed to set-up, the whole assessment plan may be 
demanding, and good management will make it practical and profitable. Team- 
peer, self and peer group assessments, as well as the panel assessment, can be 
immediate. Additionally, the work in collating marks should not impact the 
tutors’ workload significantly, and postgraduate students could support the data 
entry. Groups of 6 to 8 students could be formed, thus resulting in 12 to 15 
groups. A strict presentation time of the work followed by Q&A would be used 
to ensure it is manageable. Although the integration of a group presentation 
would clearly benefit this module, there may be concerns with using the same 
assessment method employed in another module within the same year. It may 
be addressed by considering the implementation of a group poster display and 
presentation instead. It could be done during tutorial times running over two 
weeks and could thus be more manageable. Another assessment method could 
thus be partially integrated within the module activity to ensure the overall 
students’ workload is reasonable. 

A self-assessment of the newly developed BSV10104 assessment scheme 
using the same previously used audit tools and checklist was undertaken. This 
evaluation outlined that most of the issues identified in the current assessment 
plan were dealt with by the proposed assessment scheme. Although the study 
considered students and staff’s workloads, the author still feels it as one possible 
issue needing further attention. More information from employers would, 
again, be useful to tell academic staffs on further developments requiring 
implementation. These should thus be addressed. 

It implies, the university may encourage academic staff to get familiar 
with the effective learning strategies, different types of assessments, students 
learning styles and in an evaluation of the assessment strategy with the Graduate 
Attribute model. Information from the Human Resource Department and the 
Research Department will be useful while proposing a new assessment strategy 
to raise the students learning experience, as the assessment strategy will also 
help in optimising the academic staff’s workload, thus enabling them to conduct 
research with teaching. 

CONCLUSIONS 

The aim of the study was to find out whether an alternative assessment strat¬ 
egy can improve the student’s learning experience and, employability skills 
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and attributes in the BSV10104 module. In particular the current study had 
five objectives 1) To appraise the factors influencing assessment strategies, 2) 
To identify assessment strategies available for increased learning in large co¬ 
hort, 3) To evaluate current assessment practice and explore development of the 
new methods of assessment within the BSV10104 module, 4) Identify the area 
for development, 5) Assess how the new proposed assessment strategy could 
strengthen graduate employability skills and attributes. The study has found the 
need to change the current assessment scheme of the Sustainable Developments 
module. 

A new proposed assessment strategy included the range of features to 
improve the students learning experience. For instance, use of interactive online 
discussions for reflection and grant of 5% marks for the student’s participation 
in online activities. Second, removal of the research activities. Third, use of the 
traditional exam assessment method to encompass an added assessment. Fourth, 
introduction of PBLreal case scenario on “Sustainable construction / low carbon 
building design”. Fifth, formation of online groups will provide opportunities 
for collaborative learning”. Sixth, provision of detailed formal feedback for the 
students. Also, the introduction of peer-assessment and self-assessment marking 
strategies to provide immediate feedback to the large student’s cohorts. 

The criteria’s used to evaluate the feasibility of the new proposed assessment 
strategy are 1) Five key criteria test, 2) Bloom’s cognitive domain test, 3) 
Employability skills and attributes analysis and 4) Assessment for learning 
environment test. The proposed added method of assessment complements well 
the current traditional written examination. Not only can it encourage students’ 
involvement and adoption of the deep-level approach to learning, but it can 
also develop employability skills through summarising complex information, 
communicating the findings, and working within a team. 

It implies, the university may encourage the continuous professional 
development of the academic staff and promote evaluation of the assessment 
strategy with the Graduate Attribute model. Information from the Human 
Resource Department and the Research Department will help in proposing new 
assessment strategy to heighten students experience and provide an opportunity 
to the academic staff to conduct research. 

A suggested direction for further research is to create as assessment model 
by triangulating data on the students learning styles, assessment strategies and 
the workload information. 
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APPENDICES 

APPENDIX I - STUDENT SURVEYS 

Student Questionnaire - Sustainable Development: BSV10104 
Stage 1 

1. How would you rate your understanding of sustainable development on a 
scale from 1 to 5 (5=V.Good, l=V.Bad)? 

2. Define, on your opinion, what is sustainable development 

3. Using bullet points identify where, in your opinion, Sustainable Develop¬ 
ment fits within your programme of study. 

4. What are your aspirations by undertaking this module? 

5. Please write down which programme you are studying: 

Student Questionnaire - Sustainable Development: BSV10104 
Stage 2 

1. Being in the middle of the Trimester, how would you rate your understand¬ 
ing of sustainable development on a scale from 1 to 5 (5=V.Good, 1=V. 
Bad)? 

2. How would you rate this Module so far with respects to: 

CONTENTS (please circle your answer) 

Very Good Good Bad Very Bad Average 

Please comment: 

CHALLENGES (Reflection and Research Activities) 

Very Good Good Bad Very Bad Average 

Please comment: 

TIME (to undertake activities) 

Very Good Good Bad Very Bad Average 

Please comment: 

RELEVANCE /ALIGNMENT WITH OTHER MODULES 

Very Good Good Bad Very Bad Average 

Please comment: 

1. Reflecting on the previous questionnaire filled, how would you rate, at this 
stage, the relevance of sustainable development within your programme of 
study: 

Very relevant Relevant Not Relevant 
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If not relevant, please comment: 

2. On a scale from 1 to 5, rate how the module is currently meeting your 
aspirations (5= V.Well, l=V.Bad): 

Please comment 

3. Please write down which programme you are studying: 

Student Questionnaire - Sustainable Development: BSV10104 
Stage 3 
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1 . Having finished the BSV10104- Sustainable Development module, how 
would you rate your understanding of sustainable development on a 
scale from 1 to 5 (l=V.Bad, 5=V.Good - please circle your answer )? 


1 2 3 4 5 


3. How would you rate this Module with respects to: 


CONTENTS (please circle your answer) 

Very Good Good Bad Very Bad Average 

Please comment: 

CHALLENGES (Reflection, Research Activities, Revision Lecture, Exam) 
Very Good Good Bad Very Bad Average 

Please comment: 

TIME (to undertake activities with other curriculum activities) 

Very Good Good Bad Very Bad Average 

Please comment: 

1 . How would you rate the relevance of the sustainable development mod¬ 
ule within your programme of study: 

Very relevant Relevant Not Relevant 

If still not relevant, please comment: 

2. Using bullet points identify areas you would have liked to be covered in 
this module to make it more relevant to your course and cohort as a whole. 

3. On a scale from 1 to 5, rate how the module has met your aspirations 
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(l=V.Bad, 5=V.Good -please circle your answer )? 

1 2 3 4 5 

Please comment 

4. Identify ONE topic covered within the course that you would have liked 
to cover in more depth. 

Please comment 

5. In your opinion, was the assessment method used for this module ade¬ 
quate to test your knowledge. (l=Not.Adequate, 5= V.Adequate). 

1 2 3 4 5 

Please comment 

6. Using the six definitions below please identify which, in your opinion, 
apply to the activities undertaken in the module. Please tick which ap¬ 
ply. 


Table 12: Learning cycle in relation to BSV10104 activities 


Learning Cycle Categories 

Activities 


Reflection 

Activities 

Research 

Activities 

Final 

exam 

Knowledge (1) - Involves the recall of 
specific facts and theories, methods and 
processes. 




Comprehension (2) - Involves knowing 
the information which is being commu¬ 
nicated and being able to make use of the 
material without relating it to other infor¬ 
mation or seeing its fullest implications. 




Application (3) - Focuses on having stu¬ 
dents apply what has been learned to differ¬ 
ent situations and learning tasks, requiring 
students to use information that they know 
and understand. 




Analysis (4) - Involves breaking down the 
information or situations and separating 
them into their component parts, focusing 
on the relationships of these parts with each 
other and with the whole structure. 




Learning Cycle Categories 

Activities 
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1. Finally, please identify, in your opinion, which of the same six 

definitions above, would apply to the activities listed in Table 2 below 
if they were to be implemented in your course. Please input the number 
associated to the definition against the listed activity. 

Table 13: Learning Cycle and Activities 


Activities & Assessment 
methods 

Learning cycle categories 

1: Knowledge 2: Comprehension 

3: Application 4: Analysis 

5: Synthesis 6: Evaluation 

Problem Based Learning report 


Individual Written report 


Group Written report 


Individual Presentations 


Group Presentations 


Poster Presentations 


Quizzes 


Midterm exams 


Final exam 



Synthesis (5) - Focuses on the combination 
of learned elements and parts to form a new 
whole. This includes working with pieces 
and elements and arranging them so as to 
create a new form, pattern or structure of 
the information. 




Evaluation (6) - Involves making judg¬ 
ments about the value of material and 
methods for given purposes. Judgments are 
made based on standards or criteria, either 
established by and provided for the student 
or those determined by the student. 





1. In your opinion, would you agree or disagree that an additional form of 
assessment should be included in this module? Please circle your answer 


Strongly 

Agree 




Neither 

Agree 

Disagree 

Strongly Disagree 

agree or 
disagree 


If you agree, in your opinion, which type of assessment would be most suitable: 
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If disagree, please comment: 

1. Identify ONE topic covered within the Sustainable Development module 
that you would have liked to cover in more depth, and undertake a CW on. 


2. Considering the work-load you had in other modules taught in TR1, would 
you agree or disagree that you would have had the time to undertake a CW 
within the Sustainable Development Module. Please circle your answer. 


Strongly 

Agree 

Agree 

Disagree 

Strongly Disagree 

Neither agree or 
disagree 


If you disagree, please comment: 

Could an integration of the sustainable development module be possible with 
other modules taught in TR1? Please circle YES / NO 

If so, please specify which module and how you would see the integration 
happening. 
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Audit Tool 


What is an Audit Tool? 

An Audit Tool is a good way to initiate discussion and development on an issue. It 
enables you to make clear the lange of activities which may contribute to the issue 
and the process can reassure colleagues that quite a lot of work may already be 
developed in the area. The process can also recognise local autonomy and priorities, 
within an institutional frame-work, and can: 

• encourage development of a strategic plan to clarify how assessment practices can 
be developed; 

• identify how far and in what area development should take place; and 

• give recognition to existing activity which contributes effectively. 

However an Audit also serves broader purposes: 

• raising awareness by staff of practice in general and of the institution's plans; 

• revealing or clarifying links between the aspect being audited and plans and 
str ategies in other areas; 

• engaging a wider constituency within the academic community; and 

• facilitating dialogue and development within and between teaching units. 

The purpose of this Audit is developmental, not simply to come up with an overall 
score for the course. It is designed to help teachers consider the content and design 
of a course with respect to the issue of assessment and to see where they could 
improve the course to better address this issue. 


The Assessment Audit Tool can be downloaded from the Centre’s 
website: 

www.bioscience.heacademy.ac.uk/resources/audit.aspx 

The Assessment Audit Tool can be changed to suit your requirements. This audit tool 
was last updated in December 2011 
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1. Are the assessment methods appropriate to the learning objectives? 



Score 

Ate the learning objectives (i.e. the changes in the student’s knowledge, 
skills and attitudes) explicit for the module and for each constituent element 
piece of work where appropriate? 


Ate the different types of element in the learning objectives reflected in the 
assessment? (e.g. knowledge, understanding, skills, attitudes etc) 


In setting the learning objectives is consideration given to the learning 
objectives in other concurrent or previous modules? 


Is the different achievement in each learning objective separately 
identifiable by the student in the overall assessment? 


Ate assessment methods / conditions adjusted appropriately for disabled 
students? 


Do students expenence the method of assessment before it is used 
summatively? Either in this module or in a previous module? 


A single type of assessment (e.g. all MCQs) may disadvantage some 
students. Are a variety of assessment methods used in different 
circumstances? 

(For example knowledge can be assessed using MOQ, EMQ, SAQ, essays marked for 
factual content etc. To what extent are different assessment techniques used to 
give the student a variety of ways in which to demonstrate their abilities?) 



2. The assessment methods used - are they known to provide a secure 
assessment appropriate to the teaching style? 



Score 

To what extent are the methods subjective? 


Ate assessments made from written and agreed marking schemes? 


If multiple markers are used is uniformity of marking tested and, if 
necessary, compensated for? 


If double marked is there a mechanism other than taking the average to 
resolve significant differences? 


Is marking done anonymously? (If machine marked score 4) 


Are the assessment methods appropriate to the teaching style used? 

(e.g. If the course is primarily taught using problem-based-leaming it would be 
inappropriate for the assessment to be wholly based on MCQ designed to test 
factual knowledge.) 


Ate known mark sets included in the mark spread sheets to demonstrate 
accuracy of mathematical pr ocessing / combining of marks? 


Is there external input into the assessment process? 



The Aisesvnent Audi! Tool developed by tan Hughe* and the team at the UK Centre for Biosoeoce. Umvervty of Leeds is licensed 
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3. Is the assessment set-up to reduce plagiarism? 



Score 

Are students dear as to what would be deemed to constitute plagiarism? 


Are students aware of the penalties, if they are caught plagiarising work? 


Have assessments been designed to reduce plagiarism by: 


Changing the assessment from year to year? 


Requesting evidence of how students completed coursework (e.g. by 
collecting plans, drafts, field or lab notes)? 


Setting work that could not easily be copied from the internet or 
books, either because of the format requested (e.g. poster / oral 
presentation rather than essay) or by asking for a critique of set texts 
rather than just describing a theory? 
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4. Are published marking criteria and grade descriptors available to 
students? 



Score 

Are there giade descriptors available to the students? 


Are these known to and followed by the staff doing the marking? 


Are there exemplar answers? 


Are exemplar answers available at different grades? 


Are the grade descriptors congruent with those on other modules taken by 
the students? 



5. How is the pass mark decided? Peer or criterion referenced? 

(Peer referenced is where the pass mark / giade boundaries are defined in the light of the 
actual achievement of the student body as a whole. Criterion referenced is where these are 
decided independently of the actual achievement of the student body.) If peer referenced 
deduct 1 from each score. 



Score 

Is the mark distribution for each piece of work known and considered? 


Is the distribution of marks in the module compared with that of previous 
year's cohorts? 


Is data available and used to compare the distribution of marks of a student 
cohort in this module with that in other concurrent modules? 


Is there external moderation of the marks? 


If peer referenced: are the grade boundaries set by a standard method 
across different modules? 

If criterion referenced: does more than one person determine and agree the 
grade boundaries? 



The Assessment Audit Tool developed try an Hughes and the team at the UK Centre for Biosoence. University of Leeds is licensee 
under aCreative Commons AttritJuhooNcoCommerciai-SnareAJke 3 0 Un ported License 
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6. Is assessment timely and progressive throughout the course? 



Score 

Does assessment provide a monitor of student performance throughout the 
module? 


Is there time to allow students to respond to a poor assessment before the 
end of the module? 


Is assessment timely: 


With regard to the speed with which results are available to students? 


In relation to other assessed work on the module? (So students know 
the results and have had feedback before the next piece of assessed 
work 7 ) 


In relation to other assessment on other modules? (So the totality of 
the assessment as experienced by the students is reasonably 
distributed and does not all take place in an unreasonably short 
period.) 


In relation to other commitments staff may have? (So they are not 
overloaded with marking.) 



7. Feedback 



Score 

Is feedback provided for all assessments mid-course? 


Is feedback provided for the end of module assessment? 


Is feedback provided to all students? 


Is feedback sufficiently detailed to enable students to identify particular 
weaknesses? 


Is feedback provided on omissions as well as errors? 


Do you know that all students access the feedback provided? 


Are students performing poorly counselled on a one-to-one basis? 


Does counselling take into account performance on other modules? 



The Assessment Audit Tool developed try ten Hughes and (he team at the UK Centre for Bicsoence. Unwersty of Leeds is licensed 
under aCreative Commons AttrioutiooNcoCommeroai-ShareAJike 3 0 Unported License 
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Score 

Aie these arrangements written, available to students and explicit with 
regard to format and material covered? 


Are the dates / times of any re-sit exams known to the students at least 3 
months before it takes place? 


Are the learning objectives the same? 


Are re-sit candidates given effective feedback on their first performance? 



Evaluation of 
Assessment 
Method to 
Incorporate 
Graduate Attributes 
in Building 
Surveying Module 


9. What are students' views on the quality and usefulness of the assessment? 



Score 

Are students' views on the assessment processes known and elicited each 
year? 


Is this data obtained from all students other than those absent due to 
illness? 


Are students treated as a homogeneous group (score 1) or are their views 
fragmented into those of the various sub-groups making up the student 
body? (score 4) (e.g. Levels 1 and 2 taking the same module? Students on 
different courses but taking the same module? If the students are a 
homogeneous group (i.e. all taking the same courses / modules) score 4.) 



This section of the Audit Tool looks at the proportion of total teaching time allocated 
to assessment. It is appreciated that individual students will spend different amounts 
of time involved with teaching / learning / assessment activities. Use estimated 
average values. 



Hours 

a) Total hours spent by teachers (including demonstrators, PG tutors etc) 
on assessment in this module. This includes time spent setting 
assessments, marking student work, compiling and processing assessment 
data, marking lab / project work (indude that proportion of time spent in 
labs which is actually involved in assessing the performance of the student 
at the bench if this is done). 


b) Total hours of teaching time spent by staff in direct contact with 
students. This is usually time-tabled time for teachers (of all levels) to be 
in contact with students. If students are taught for 1 hour in, say, 5 small 
groups, then 5 hours of teacher time would be involved. Do NOT include 
preparation time or time spent on assessment of students. 


c) Total hours spent by a student in being assessed. Indude examination 
and viva time, time spent actually writing assessed course work (e.g. 
essays, practical write-ups etc) but not the time spent preparing the 
material. Estimate where necessary. Assume course work takes 0.5hr to 
write 1 page. 


d) Total hours for which a student is involved in any form of teaching / 
learning / assessment activity (lectures + practical + self-directed + 
directed + tutorials + others etc.) on this module. This is the total hours 
you would expect this module and the work associated with it to occupy 
the student. Estimate where necessary. 


e) How proportional is the staff time spent in assessment to the marks 
awarded? How proportional is the student time spent in completing the 
work for an assessment to the marks awarded? (For each assessed item 
consider the proportionality between the fraction of the total marks 
awarded and the assessment time devoted to it. Consider this for both 
staff and students. This item is not represented numerically but you should 
note areas where the time spent by staff in completing the assessment is 
very large compared with the proportion of marks given for the work.) 
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Action Plan 

Make a note of the resources you will need and whose help will be required. 

1 . 


2 . 


3. 
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Employability Audit Tool 



What is an Audit Tool? 

An audit tool is a good way to initiate discussion and development on an issue. It 
enables you to make dear the range of acbvibes which may contribute to the issue and 
the process can reassure colleagues that quite a lot of work may already be developed 
in the area. The process can also recognise local autonomy and priorities, within an 
institutional fra me-work, and can: 

» encourage development of a strategic plan to clarify how employability can be 
developed in relation to a particular discipline; 

« identify how far and in what area development should take place; 

• give recognition to existing activity which contributes effectively. 

However an audit tool also serves broader puiposes: 

• raising awareness by staff of practice in general and of the institution's plans; 

« revealing or clarifying links between the aspect being audited and plans and 

strategies in other areas; 

« engaging a wider constituency within the academic community; and 
« facilitating dialogue and development within and between teaching units. 

The purpose of this Audit is developmental, not simply to come up with an overall 
score for the course. It is designed to help teachers consider the content and design of 
a course with respect to the issue of employability and to see where they could 
improve the course to better address this issue. 
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The Employability Audit Tool can be downloaded from the Centre's 
website: 

www.bioscience.heacademy.ac.uk/resources/audit.aspx 

The Employability Audit Tool can be changed to suit your requirements. This audit tool 
was last updated in December 2011 
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1. Graduate employment 



Score 

Do academic staff know who actually employs your graduates? 


Has graduate employment destination data been circulated to academic staff 
within the last 2 years? 


Do current students know who employs graduates from this course? 


Do recent graduates visit to talk about their current jobs? 


Are students made aware of where they can obtain information on graduate 
destinations in employment? 


Are students aware at an early stage of the employment opportunities open 
to them? 



2. Career-path development 



Score 

Are visitors giving research talks encouraged to reveal their own career 
paths? 


Are graduate career profiles available to students? 


Do recent graduates visit to talk about their career paths? 


Do more senior graduates visit to talk about their career paths? 


Are students explicitly taught career management skills? 



3. Relationships with employers 



Score 

Have you made potential employers aware of the skills your students 
develop? 


Is your institution / unit on the list of favoured institutions with important 
employers? 


Do you know what employers perceive to be the strengths and weaknesses 
of your students? 


Do students have the opportunity to visit local employers? 


Do you have good communication with major employers of your graduates? 


Do employers visit your unit to give talks about employment opportunities? 


Do employers attend any student final year project presentations? 


Do you know what skills, knowledge and attitudes your major employers see 
as becoming more important in the next 4 years? 



The EmptayaWity Audit Tool dcvdcped Cry an Hughes and die team al the UK Centre for Bosoenoe, University of Leeds is licensed under 
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4. Options for work experience 



Score 

Are work experience opportunities provided / encouraged during vacations? 


Are sandwich placements provided / encouraged as part of the course? 


Are overseas placements possible and encouraged for students? 


Are realistic simulations used to give experience of real work situations? 


Do some students carry out course project work in real settings with 
employers? 


Are work placements available in areas not involving your spectfic discipline? 


What proportion of students on your course have obtained work exper ience 
before graduation? (0=don't know; 1=<5%; 2=5 to 20%; 3=20 to 50%; 

4=>50%) 


Are students on woik placements supported by a process which encourages 
reflection and emphasises breadth of learning opportunities? 
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5. Does your curriculum promote employability? 



Score 

Do you know specifically what employers are looking for in graduates? 


Have employers reviewed your curriculum and provided feedback on its 
content? 


Are generic skills (e.g. communication, group working, IT) explicitly taught? 


Are generic skills assessed? 


Is there a skills matrix which is completed by each student? 


Are subject-specific skills taught and practiced? 


Are subject-specific skills assessed? 


Can you detect any of your students who are not numerate? 


Do you assess ability to write dear, conase, correct English? 


Are key skills and employability issues in the relevant QAA benchmarking 

statement incorporated in your curriculum? 

www. qaa. ac. uk/academidnfrastructure/benchmark/ 


Do students have a choice of modules or choice of work areas within a 
module so they can tailor the content of their course to their perceived needs 
/ interests 7 


Are appropriate professional attitudes developed and discussed with 
students? 



The Employability Audit Tool developed by an Hughes and the team at the UK Centre far Bosoeooe University of Leeds is licensed under 
a Creative Commons AttnDubonNcnCommeraak-ShareAlike 3 0 Unpcrted License 
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5. Does your curriculum promote employability? (cont.) 



Score 

Have you identified where work related learning activities take place in the 
course and are these made explicit to students? 


Have opportunities to increase work related learning in the course been 
identified and taken? 


Aie all students given a basic grounding in ethics within the discipline field? 



6. Are students helped in obtaining and developing careers? 



Score 

Is a 'Record of Achievement' maintained throughout the course? 


Is reflection on and r eview of achievements actively promoted within the 
course? 


Do students get help with producing / improving a CV? 


Do students get help with letters of application for employment? 


Is help with module choice available in each year? 



7. Extra-curricula activity 



Score 

Is the contribution of extra-curricula activity to CV and skills development 
explained to students early in the course? 


Are extra-curricula activities and responsibilities recorded by your students? 


Are extra-curricula activities known to staff (e.g. personal tutors)? 


Are arrangements in place to encourage voluntary work by students? 



8. General 



Score 

Is there an effective relationship between the course team and your Careers 
Service? 


Are students explicitly guided in the course to make contact with the Careers 
Service? 


Do you know the name of the Careers Adviser associated with your subject? 


Are your students encouraged to have confidence and high aspirations? 



The Emptayabrfrty Audit Tool developed oy an Hughes and Vie team at the IX Centre for Bosocnoe Unrversdy of Leeds is licensed under 
a Creative Commons AttrioutooAtonCommeraak-ShareAJifce 30 Unported License 
Based on a wort atwwv* hosaenoe heacademy acute 


©©© 
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8. General (cont.) 



Score 

Do staff generally have access to full information about a student's in-course 
and extra-curricula performance (e.g. student's CV) when writing references? 


Have you considered employability in the context of widening participation? 


Have you considered employability in the context of disability? 


Have you considered employability in the context of ethnicity? 
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Action Plan 

Make a note of the resources you will need and whose help will be required. 

1 . 


2 . 


3. 


The EmatoyaWrty Audit Toot developed try '.ar. Hughes and no team at the UK Centre for 
a Creative Commons AttrnuhanNcnCcmreraai-Sna/eAJirue 30 Unported License 
Eased an a wotk rvw* botocnce hcacademy.acuk 


University o< Leeds is licensed under 

[CCJ ©@© 
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Appendix 7 


Module evaluation checklist 

This checklist should be completed prior to the first time a module is implemented in blended or 
fully online format, as part of the quality assurance procedures for blended and online delivery that 
are described in the Quality Framework (for the definition of a blended module see section A9) 

The criteria within this checklist correspond to the main tenets of good practice described in this 
guide, which are expanded upon more fuHy in the Edinburgh Napier publication Pedagogy and 
/earning technology: a practical guide. 

This checklist should be used in an independent review of a blended or online module to be 
conducted by an Academic Development Adviser (ADA) Online Learning who has not been 
involved in the development of the module, or by an appropriately experienced tutor or reviewer 
from outwith the module team. In addition, the checklist can serve as a reference to module 
developers during the online module design and development stage. 

It is not expected that ail catena are met for all modules. Fully online modules should meet the 
majority of the catena. It is left to the discretion of the knowledgeable reviewer which criteria to 
fulfil. 

Instructions to reviewer please tick the appropriate box against each of the criteria provided, 
and wnte any additional comments or recommendations you have in the space provided If N'A 
has been selected please explain why. Return checklist to module leader who can seek additional 
support and guidance from the faculty's Academic Development Adviser (ADA) Online Learning. 
Please remember to sign and date thrs form. 

Module title: _ 
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1) Module material 


Criteria 

YES 

NO 

N/A 

Learning outcomes are stated wherever appropriate 

□ 

O 

□ 

Subject material (in introductions, units) is dearly written 

□ 

□ 

□ 

Subject material is written inclusively (eg culturally biased terms and 
examples are avoided wherever possible) 

□ 

□ 

□ 

The structure and organisation of the module (eg dates and deadlines, 
the sequence of events) is explicitly stated 

□ 

□ 

□ 

Full details of all cone texts and resources are provided 

□ 

o 

□ 

External links lead to relevant and reputable resources 

□ 

□ 

□ 

Third party material is copyright cleared 

□ 

□ 

□ 

Additional notes and recommendations 


2) Coursework arid assessment 


Criteria 

YES 

NO 

NTA 

Assessment specifications and criteria are dear and explicit 

□ 

□ 

D 

Periotic deadlines are in place to help ensure engagement 

□ 

□ 

□ 

There is an appropriate mix of individual and collaborative pieces of 
coursework 

□ 

□ 

□ 

There are opportunities for penodtc self-testing and'or suggested 
self-reflective tasks and activities 

□ 

□ 

□ 

The assessed work is likely to be well-supported by the range of 
tools and resources provided online 

□ 

□ 

□ 

The work to be undertaken is likely to be engaging without 
overloading students 

□ 

□ 

□ 

Additional notes and recommendations: 
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3) Communication and collaboration 


Criteria 

YES 

NO f 

Students are required to collaborate on key tasks 

□ 

□ 

There is a means for students to ask general questions of the tutor 
and each caber (eg a problems forum) 

□ 

□ 

There are opportunities to communicate synchronously (eg using a 
chat tool) where this would be beneficial 

□ 

□ 

Requirements for communicating and collaborating online are clearly 
stated (eg where optional and not, guidelines) 

□ 

□ 

Students are provided with appropriate online spaces to support 
group work (eg private discussion areas, wikis) 

□ 

□ 

There are online social spaces provided for non-assessed, informal 
discussion and communication 

□ 

□ 

Additional notes and recommendations: 


Evaluation of 
Assessment 
Method to 
Incorporate 
Graduate Attributes 
in Building 
Surveying Module 


4) Student support 


Criteria 

YES 

NO 

N/A 

Students are provided with dear information about how to study 
effectively in the context of this module, including how to make good 
use of the online tools and resources 

□ 

□ 

C 

Introductory ice break mg'bonding activities are in place 

□ 

□ 

c 

J ust-m-time guidance (eg that reinforce task requirements or 
provide useful study tips) is embedded at appropriate points m 
subject materials and activity descriptors 

□ 

□ 

c 

What the student can expect from the tutor (eg in terms of response 
rate, when they will be online) is dearly stated 

□ 

□ 

c 

VLE/other technical specifications are provided or linked to 

□ 

□ 

c 

Additional support features (eg glossary, calendar, announcements, 
world dock) are provided where useful 

□ 

□ 

c 

Additional notes and recommendations: 


5) Use of multimedia (visual and/or audio, static and/or interactive) 


Criteria 

YES 

NO 

N/A 

V jltimed a is used appropriately to present subject material and/or 
to complement text-based explanations 

□ 

□ 

□ 

Multimecia elements are easy to use and interact with 

□ 

□ 

□ 

Additional notes and recommendations: 
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Criteria 

YES 

NO 

NA 

The online module environment is easy to navigate 

□ 

□ 

□ 

Information-equivalent alternatives to static and interactive 
multimedia content are provided 

□ 

□ 

O 

Links to any browser plug-ins required are provided 

□ 

□ 

□ 

Appropriate alternative means for navigating content (eg search, 
site index, actn/rbes-view) are m place 

□ 

□ 

□ 

Visual design is dear and non-distracting 

□ 

□ 

□ 

Text is readable and presented in non-serif fonts 

□ 

□ 

□ 

Links to external websites or content files open 14 ) in a new browser 
window 

□ 

□ 

□ 

Additional notes and recommendations: 


A note on programme level online provision 

It is noted that guidance and materials might be more appropriately placed on the programme 
home rather than on the module site Material there could include, but ts not restricted to: 

• Teaching team 

• Module descriptors. 

• Programme level online problems forum 

• Programme level online induction activities and documentation. 

• Links to Edinburgh Napier library. C&TT, Student Affairs. SSCC (Student staff consultative 
committee), dass representatives, plagiarism website. 

• General study skills advice 

• Technical guides. 

7) Final comments and recommendations 

Please use the space below to make any final comments you have and ndude any changes you 
would recommend be made to the module prior to its implementation. 


Signed: 

Date reviewed: 
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APPENDIX III - PROPOSED “STUDENT ACTIVITY” AND “AS¬ 
SESSMENT” SECTIONS 

Considering the proposed new assessment scheme the student activity and 
the module assessment should be as follow: 


Table 14: Student Activity 


Mode of activity 

L&T activity 

NESH 

Face-to-Face 

Lecture 

24 

Face-to-Face 

Tutorial/Seminars/Group work 

24 

Assessment 

Exam, Presentation 

4 

Online 

Reflection activities 

30 

Individual learning activities 

Group work 

118 

TOTAL NESH 


= 200 hours 
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Table 15: Assessment 


Week 

Type of assessment 

Weighting 

LOs 

covered 

Length/ volume 


Component: Assessment 
One 

Enter assessment ele¬ 
ments): 




8,9 

Group display poster & oral 
presentation 

25% 

3,4,5 

15min 

9 

Self and Peer Assessment 

10% 

To be 
addressed 

1 A4 page of 
standards and 
criteria 

12 

Interactive online discussion 
participation 

5% 

1-6 

100 words per 
discussion 


Component subtotal: 

40% 



Component: Assessment Two 

Enter assessment element(s): 




14/15 

Centrally timetabled exam 

60% 

1-6 

3hrs 


Component subtotal: 

60% 




Module total: 

100% 
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